Skip to content

KAFKA-10341: Add 2.6.0 to system tests and streams upgrade tests#9116

Merged
rhauch merged 1 commit into
apache:trunkfrom
rhauch:kafka-10341
Aug 4, 2020
Merged

KAFKA-10341: Add 2.6.0 to system tests and streams upgrade tests#9116
rhauch merged 1 commit into
apache:trunkfrom
rhauch:kafka-10341

Conversation

@rhauch

@rhauch rhauch commented Aug 3, 2020

Copy link
Copy Markdown
Contributor

BTW, tests/kafkatest/version.py was already modified to define the 2.6.0 version constants for the system tests, but these variables were never used. Thus, no need to modify that file.

Based upon #8378 (for 2.5)

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@rhauch

rhauch commented Aug 3, 2020

Copy link
Copy Markdown
Contributor Author

Just kicked off a build of the Streams system tests (e.g., TC_PATHS=tests/kafkatest/tests/streams/streams_upgrade_test.py) using this PR:
https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4082/

and a full system test run using this PR: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4083/

@rhauch
rhauch requested review from abbccdda and mjsax August 3, 2020 22:59
@mjsax mjsax added streams tests Test fixes (including flaky tests) labels Aug 3, 2020

@mjsax mjsax left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @rhauch! LGTM assuming Jenkins and system tests passed.

@rhauch

rhauch commented Aug 4, 2020

Copy link
Copy Markdown
Contributor Author

Thanks, @mjsax

The streams-only system test run (https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4082/) passed. The other was interrupted by a Jenkins restart. I'll restart the full system test run tomorrow AM.

@rhauch

rhauch commented Aug 4, 2020

Copy link
Copy Markdown
Contributor Author

Green builds on JDK 11 and 14, and two unrelated failures (known flaky integration tests, not system tests) on JDK 8:

Test Result (2 failures / +1)
    org.apache.kafka.streams.integration.EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta[false]
    org.apache.kafka.streams.integration.EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta[true]

I started a second run of all system tests with this branch: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4088/

@rhauch

rhauch commented Aug 4, 2020

Copy link
Copy Markdown
Contributor Author

The [second run|https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4088] with all of the system tests had [two failures|http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2020-08-04--001.1596577078--rhauch--kafka-10341--f0164cbb3/report.html]:

Module: kafkatest.tests.core.round_trip_fault_test 
Class:  RoundTripFaultTest 
Method: test_round_trip_workload_with_broker_partition

Module: kafkatest.tests.client.consumer_test
Class:  OffsetValidationTest
Method: test_static_consumer_bounce 
Arguments: {   "bounce_mode": "all",   "clean_shutdown": true,   "num_bounces": 5,   "static_membership": false }

These have been somewhat flaky recently on the 2.6 branch (at least), but they are not directly affected by this PR.

@rhauch
rhauch merged commit 1112fd4 into apache:trunk Aug 4, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

streams tests Test fixes (including flaky tests)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants